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Abstract 

Several  systems  have  been  proposed  or  implemented  that  allow  authors  to  store 
fragments  of  text  in  a  computer  memory  and  that  allow  readers  to  retrieve  sequences 
of  these  fragments  in  response  to  queries.  Since  two  queries  may  retrieve  the  same 
fragments  in  different  orders,  we  refer  to  such  systems  as  non-linear  text  systems. 
Linear  text  systems  are  books,  papers,  and  so  on.  They  encourage  the  reader  to  read 
consecutively  within  the  linear  ordering  imposed  by  the  text.  We  consider  three 
questions.  For  what  knowledge  exploratory  applications  is  non-linear  text  helpful? 
How  big  should  the  fragments  of  a  non-linear  text  system  be?  How  expressive 
should  such  systems  be?  We  use  a  formal  model  to  answer  these  questions. 

1.   Setting 

Partly  in  reaction  to  the  difficulty  of  natural  language  understcmding  and  partly 
because  it  seems  to  be  an  attractive  and  liberating  approach  to  exploring  knowledge, 
non-linear  text  systems  have  caught  the  imagination  of  researchers  [AM84,  B45,  B82, 
E84,  EWN73,  KW83,  MM79,  N79,  Nel83,  S85,  T83,  Wey82,  Woj79,  WB85].  These 
systems  consist  of  fragments  of  text  embedded  in  a  directed  graph  with  labelled 
edges.  The  systems  support  a  query  language  allowing  users  to  select  various  sets  or 
sequences  of  these  fragments. 

The  facilities  allowed  by  these  systems  vary.  Many  incorporate  state  of  the  art 
technology  in  their  user  interfaces,  such  as  high  resolution  graphics,  sophisticated 
support  for  many  authors  to  collaborate  on  an  article,  and  even  piaorial  simulations 
[WB85]. 

This  paper  concentrates  on  another  question:  when  is  the  expressiveness  of 
non-linear  text  actually  needed?  That  is,  we  seek  to  separate  the  benefits  that  non- 
linear text  may  give  just  by  virtue  of  being  computer-based  (and  therefore  potentially 
more  up-to-date  and  flashy  than  paper-based  text),  from  the  benefits  that  non- linear 
structxire  may  give.  The  most  relevant  previous  work  is  Wojick's  [Woj79]  description 
of  his  tree-based  writing  method,  where  he  argues  for  the  superiority  of  tree-styled 
text  over  linear  text.  Raymond  and  Tompa  [RT85]  address  the  expressiveness 
problem  in  the  context  of  searching. 

1.1.  Toarists  and  Short  Stories 

Suppose  you  are  a  tourist  interested  in  visiting  museums  in  a  foreign  dty.  You 
may  be  interested  in  visual  arts.  You  may  want  to  see  museums  in  your  local  area. 
You  may  only  be  interested  in  inexpensive  museums.  You  certainly  want  to  make 
sure  the  museums  you  consider  are  open  when  you  want  to  visit  them. 

Now,  your  gxiidebook  may  be  arranged  by  subject,  by  name  of  museum,  by 
location,  and  so  on.  The  trouble  is:  if  you  are  interested  in  any  arrangement  other 
than  the  one  it  uses,  you  may  have  to  do  a  lot  of  searching.  You  are  not  likely  to 
find  all  the  visual  arts  museums  in  one  section  of  a  guidebook  that  has  been 
organized  by  district.    You  may  carry  several  guidebooks,  each  organized  by  a 
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criterion  you  may  be  interested  in.   The  number  of  such  guidebooks  is  a  measure  of 
the  need  for  a  non-linear  text  system. 

Now,  suppose  you  sit  down  for  a  night  of  reading  short  stories.  You  may  not 
want  to  read  them  in  the  order  specified  by  the  table  of  contents,  but  you  are  likely  to 
read  any  story  you  choose  in  the  order  it  is  written.  In  this  case,  a  non-linear  text 
system  provides  no  benefit  over  linear  text.  There  is  no  need  for  more  than  one 
arrangement. 

These  examples  illustrate  that  the  need  for  a  non-linear  text  system  is  not 
inherent  in  the  text,  but  in  the  questions  or  choices  the  reader  may  make.  When  you 
pick  up  a  book  of  stories,  you  will  usually  either  read  a  story  through  or  read  a  prefix 
of  the  story.  When  you  pick  up  a  guidebook,  you  may  have  one  of  many  questions 
in  mind.  Some  of  the  questions  are  incompatible  with  one  another  in  the  sense  that  a 
book  optimized  to  answer  one  kind  of  question  (e.g.  about  visual  art  museums)  may 
be  difficult  to  use  to  answer  another  (e.g.  about  museimis  in  one  neighborhood). 

The  next  section  formalizes  the  question  of  when  and  how  much  an  application 
needs  non-linear  text.  Section  3  formalizes  the  contrast  between  linear  and  non-linear 
text  systems  and  considers  normal  forms  for  non-linear  text.  Section  4  discusses  open 
questions  and  the  limitations  of  our  model.  •.  -    '  < 

2.  Model  for  Linear  Text  '■■"^'<.  '-::■"'        - 

The  indivisible  units  of  information  of  our  model  are  called  atoms.  An  atom 
may  be  a  description  of  a  museimi  or  a  description  of  a  part  of  a  museum.  Its  scope 
is  not  a  priori  bounded.  However,  atoms  must  be  smail  enough  so  that  an  integral 
number  of  them  answer  any  question.  One  atom  may  have  alternate  paraphrases  in 
text  and  may  be  a  paragraph  long,  a  page  long,  or  perhaps  a  long  article.  We  often 
blur  the  distinction  between  an  atom  and  its  paraphrases. 

A  choice  is  a  string  (i.e.  a  sequence)  of  atoms.  We  assimie  that  no  atoms  are 
repeated  within  a  choice.  The  set  of  choices  are  what  a  reader  might  want  to  know, 
(e.g.  about  visual  art  museums  or  free  museums).  Choices  are  the  potential 
information  requirements  expressed  as  strings  of  atoms.  The  requirements  may  be 
well  or  badly  satisfied  by  actual  text. 

This  definition  embodies  three  abstractions.  First,  we  consider  the  choices  to  be 
sequences  even  though  a  user  may  not  care  about  the  order.  This  assumption  doesn't 
affect  the  generality  of  our  model:  the  system  presents  sets  in  some  order;  we  model 
the  choice  by  a  presentation  ordering  on  the  set.  If  different  users  specify  the  same 
set  of  atoms,  the  system  will  satisfy  both  by  a  single  choice  on  those  atoms. 
Obviously,  when  the  order  does  matter,  sequences  of  atoms  are  a  better  model  of 
choices  than  sets  would  be.  Second,  we  assume  the  choices  have  no  repetitions, 
since  the  user  doesn't  want  to  see  the  same  information  twice.  We  consider  a 
summary  of  a  bunch  of  information  to  be  a  different  atom  from  the  information  it 
summarizes.  Third  and  most  important,  we  purposely  abstract  out  the  query  facilities 
by  assuming  that  the  set  of  possible  choices  is  given.  Our  motivation  is  to  simplify 
the  analysis  and  to  ignore  the  problem  of  searching  in  favor  of  concentrating  on  the 
question  of  what  a  system  must  be  able  to  express. 

We  concatenate  strings  to  form  larger  strings  in  the  usual  way  (see  [IJ*81]  for 
example).  If  u  and  v  are  strings,  then  uv  is  the  string  consisting  of  u  followed  by  v. 
The  string  £  is  the  empty  string,  containing  no  atoms.  The  length  of  a  string  x  is  the 
number  of  atoms  in  the  string,  denoted  [x|.  The  expression  set(x)  is  the  set  of  atoms 
contained  in  string  x. 
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A  string  j:  is  a  substring  of  a  string  y  ifB  u,  v  such  that  uxv  =  y.  A  substring  is 
proper  if  either  u  or  v  is  not  empty.  A  string  x  is  a  suffix  of  a  string  >  if  3  u  such 
that  ^  =  01.  Two  strings  z  and  y  are  disjoint  if  set(x)  p)  set(y)  =  0. 

2.1.  Linearizable  Choices 

We  say  that  a  set  of  choices  C  is  linearizable  if  there  is  a  string  s  such  that 

1)  the  lengU)  of  s  is  the  number  of  distinct  atoms  in  C  (hence  s  has  no  repetitions); 
and 

2)  every  member  c  C  C  is  a  substring  of  s. 

Example:  The  reader  of  short  stories  would  have  a  linearizable  set  of  choices, 
since  he  or  she  would  be  interested  in  reading  a  story  or  a  part  of  a  story  as  the 
author  has  written  it,  so  each  choice  would  correspond  to  a  substring  of  the  atoms  in 
the  book. 

We  would  like  to  determine  constructively  whether  a  set  of  choices  is 
linearizable. 

We  say  that  two  strings  x  and  x'  are  compatible  if  3  u,  v,  w,  u',  w'  such  that 
x=uvw,x'  =  u'vw' ,  set(uw)f\set{u'w')  =  0,  and  either  ;j,j,    ..- 

(i)  V   =  £  that  is  v  is  the  empty  string  (so  x  and  x'  are  disjoint);  or 

(ii)  one  of  u  and  u'  is  empty  and  one  of  w  and  w'  is  empty. 

Suppose  X  and  y  are  compatible  and  „' ,u'  ,v ,w ,w'  are  as  in  the  definition.  If  u  # 
£,  u'  =  £,  w  =  (f,  and  w'  ^  C,  then  wc  say  that  x  pre-ovsrlaps  x';  if  m  and  v  are 
both  empty  strings,  then  x  is  clearly  a  substring  of  x' . 

Proposition  1:  If  x  and  x'  are  compatible  and  distinct,  either  one  is  a  proper 
substring  of  the  other,  one  pre-overlaps  the  other,  or  they  are  disjoint.   [] 

Examples:  The  strings  x=abc  and  x'  =bc  are  compatible  and  x'  is  a  substring  of 
X.  The  strings  x=abc  and  x'  =bcd  are  compatible  and  x  pre-overlaps  x' .  The  strings 
x=abc  and  x'  =  ac  are  not  compatible.  The  strings  x=abc  and  x'=def  are  compatible 
and  disjoint. 

The  pre-o\'erlap  graph  for  a  set  of  choices  C  is  a  directed  graph  (C,£)  such  that 
(x,x')  i  E  \i  and  only  if  x  pre-overlaps  x' . 

Theorem  1:  C  is  linearizable  if  and  only  if  every  pair  of  choices  in  C  is 
compatible  and  the  pre-overlap  graph  for  C  is  acyclic. 

Proof:  See  appendix. 

Examples:  Let  w  =  ac,  x  =  ab,  y  =  bc  and  z=ca  be  strings.  Then  C  =  {x,^}  is 
linearizable,  since  x  and  y  are  compatible  and  the  pre-overlap  graph  consists  of  the 
single  edge  x  ^  y.  However,  C  =  {h',x}  is  not  linearizable,  since  w  and  x  are  not 
compatible.  C  =  {x,y,z}  is  not  linearizable,  because  the  pre-overlap  graph  has  edges 
X  -  ^^i  -  z  2  -  X,  so  is  cyclic. 

2.2.  Parentheses  Linearizable  Choices 

The  above  model  of  linearizable  text  ignores  the  fact  that  typographic  and 
syntactic  cues  in  text  often  signal  a  descent  into  a  level  of  detail  that  may  not  interest 
all  readers.  These  cues  take  the  form  of  parentheses,  footnotes,  subsections,  and 
words  like  "proof,"  "see  appendix,"  and  so  on.^  Since  a  reader  may  choose  to  skip 

'  Other  cues  are  more  subtle:  for  example  if  X  and  Y  are  long,  then  the  conditional  structure  in 
the  statement  "if  A  then  X  else  Y"  may  serve  as  a  cue  to  the  reader  to  avoid  reading  X  if  A  is  false 
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over  such  detail,  the  text  can  support  sets  of  choices  that  are  not  linearizable. 
Computerized  systems  such  as  Zog  [AM84]  and  so-caUed  "outline  processors" 
designed  for  personal  computers  offer  this  power,  by  making  levels  of  detail  explicit. 
We  characterize  the  power  of  these  techniques  below. 

We  define  acceptable  strings  and  enclosed  strings  recursively  as  follows, 
i)  if  X  is  a  string  without  parentheses,  then  x  is  acceptable, 
ii)  if  X  and  y  are  acceptable,  then  xy  is  acceptable, 
iii)  if  X  is  acceptable,  then  (x)  is  acceptable  and  is  an  enclosed  string, 
iv)  nothing  else  is  either  enclosed  or  acceptable. 

Suppose  we  define  choices  as  a  set  of  strings  without  parentheses  (as  before). 
A  set  of  choices  C  is  parentheses  linearizable  if  there  is  an  acceptable  string  s  such 
that 

1)  the  length  of  s  is  the  number  of  distinct  atoms  in  C  plus  the  number  of  parentheses 
in  s;  and 

2)  every  member  c  6  C  is  a  substring  of  some  string  s'  that  is  obtained  from  s  by 
removing  some  enclosed  substrings  and  then  removing  all  parentheses.   [] 

Obviously,  any  set  of  choices  that  is  linearizable  is  parentheses  linearizable. 
The  converse  is  not  true. 

Examples:  Let  x  =  abc,  y-ac,  z=ba.  C  =  {y,z}  is  linearizable.  C  =  {x,^'}  is 
not  linearizable,  but  is  parentheses  linearizable  with  string  s  =  a(b)c.  C  =  {x,y,z}  is 
neither  linearizable  nor  parentheses  linearizable,  because  of  ba  and  abc. 

Enclosed  strings  are  helpful  when  all  choices  are  subsequences  of  the  same 
string.^  For  example,  in  a  mathematics  text,  the  order  reflects  a  nearly  total 
prerequisite  ordering  among  the  atoms.  Since  the  choices  normally  obey  this 
prerequisite  ordering,  x  and  z  from  the  previous  example  would  probably  not  both  be 
choices.  In  text  with  less  prerequisite  structure  such  as  the  guidebook,  x  and  z  would 
be  possible.  Even  more  likely  (and  still  not  parentheses  linearizable)  is  that  there 
would  be  no  clear  notion  of  what  is  overly  detailed  and  what  isn't.  For  the 
guidebook  case,  there  may  be  choices  isomorphic  to  {abcde,acfhk,bdehk,  •  •  •  }.  That 
is,  the  choices  have  some  atoms  in  common,  but  are  incompatible  with  one  another 
and  cannot  be  made  compatible  by  eliminating  enclosed  strings.  It  is  possible  to 
generalize  the  parentheses  linearizable  idea  to  allow  many  kinds  of  parentheses 
depending  on  the  kind  of  choice  one  is  interested  in.  This  corresponds  loosely  to 
having  severjil  overlapping  hierarchies,  where  each  hierarchy  may  have  to  do  with  a 
different  attribute  or  kind  of  choice,  e.g.  location,  subject  matter,  price.  This  is 
difficult  to  render  palatable  on  paper,  but  is  possible  in  principle.  It  is  a  helpful 
technique  for  a  non- linear  text  system  that  supports  knowledge  exploration  [DT85, 
SS5]. 

The  reader  may  object  that  we  have  ignored  the  possibility  of  using  cross- 
references.  Cross-references  are  difficult  to  model  realistically.  For  example,  one 
could  model  them  as  edges  from  some  text  fragments  to  other  fragments.  One  could 
then  say  that  a  set  of  choices  can  be  embedded  (i.e.  is  cross-reference  linearizable)  in 


and  Y  if  X  is  true. 

'  A  subsequence  of  a  string  is  a  sequence  of  (not  necessarily  consecutive)  members  of  that  string 
in  the  same  order  as  they  appear  in  the  string. 
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such  a  structure  if  each  choice  is  a  path  in  the  structure.  A  complete  graph  on  the 
atoms  would  embed  any  set  of  choices.  But  such  long  cross-reference  lists  are  dearly 
unrealistic.  (One  could  limit  the  degree  of  the  vertices,  but  that  makes  the  sets  of 
cross-reference  linearizable  choices  a  function  of  size  as  well  as  structure.)  Moreover, 
cross-references  tend  to  be  used  more  as  pointers  to  other  choices,  reminding  the 
reader  to  read  about  some  related  subject.  As  such  they  fall  outside  our  model. 

2.3.   Measuring  Non-linearlzabillty 

Suppose  we  discover  that  a  set  of  choices  is  not  linearizable.  We  would  like  to 
pose  the  question:  how  non-linearizable  is  the  set  of  choices?  One  measure  we  have 
is  the  minimum  length  string  s,  such  that  each  choice  in  a  choice  set  C  is  a  substring 
of  s.  We  call  s  the  minimum  length  superstring  for  C?  We  define  the  non- 
linearizability  of  a  set  of  choices  C  to  be  the  ratio  of  the  length  of  the  minimum 
length  superstring  for  C  to  the  nimiber  of  distinct  atoms  in  C. 

Example:  Suppose  x  =  abc,  >  =  cb,  z  =  ac.  If  C  =  {x,  y,  z)  then  a  superstring 
of  minimum  length  is  5  =  abcbac.  The  non-linearizability  of  C  is  two. 

Note  that  the  ratio  is  no  less  than  one  (I'or  linearizable  choices)  and  is  no  greater 
than  the  svmi  of  the  lengths  of  the  choices  divided  by  the  number  of  distinct  atoms 
among  the  choices.  Various  heuristics  to  get  better  estimates  are  possible.  For  many 
important  special  cases,  it  is  easy  to  get  a  good  estimate. 

Example:  In  the  guidebook  example,  each  kind  of  choice  corresponds  to  a 
reorganization  of  nearly  the  whole  book.  Thus,  the  non-linearizability  of  the  set  of 
choices  is  approximately  the  number  of  different  kinds  of  choices.  If  the  kinds  of 
choices  are  subject  matter,  location,  and  price,  then  the  non-linearizability  would  be 
three.  (This  would  still  be  the  case  even  if  we  allowed  parentheses  or  a  reasonable 
number  of  cross-references.) 

Example:  By  contrast,  we  may  have  a  technical  paper  that  most  people  will  read 
entirely  or  stop  somewhere  in  the  middle.  However,  there  are  certain  points  where 
different  orderings  are  possible.  For  example,  the  paper  presents  a  set  of  definitions 
and  then  a  set  of  assertions.  But  the  reader  does  not  need  to  know  all  the  definitions 
before  reading  the  first  assertion.  Thus,  the  reader  interested  in  reading  the  first 
assertion  may  prefer  to  skip  over  most  definitions.  Thus  the  minimal  superstring 
may  have  the  form:  dydid-fi^-j>-^d-pYi  where  the  d^  terms  represent  definitions  and 
the  p,  terms  represent  assertions.  Only  dy  is  needed  for  p^.  Here  the  non- 
linearizability  is  only  1.33. 

The  non-linearizability  measure  is  meant  to  inform  our  intuition  about  when  a 
non-linear  text  system  would  be  most  helpful.  The  higher  the  measure,  the  more 
useful  is  non-linear  text.  The  next  section  presents  a  model  for  non-linear  text  and 
discusses  desirable  properties  of  text  fragments  to  support  a  set  of  choices. 

3.  Non-linear  text  systems 

In  linear  text  system,  the  table  of  contents  or  an  index  maps  a  choice  into  a 
substring.  In  an  idealized  non-linear  text  system,  some  searching  method  would  map 
a  choice  into  a  concatenation  of  strings  of  atoms.  Each  such  string  corresponds  to  a 
text  fragment  that  can  be  read  in  isolation  of  other  fragments  (i.e.  it  is  "coherent"  or 
"self-contained"). 


'  -  As  it  happens,  the  problem  of  finding  a  minimum  length  superstring  of  a  set  of  choices  (where 
each  choice  is  of  length  three  or  greater)  is  NP-complete  [GMS80].  This,  of  course,  does  not  prevent 
us  from  finding  the  minimum  length  superstring  at  least  in  principle. 
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Formally,  a  non-linear  text  system  is  a  pair  (S,  f),  where  5  is  a  set  of  strings  of 
atoms  (which  are  self-contained  text  fragments)  and  /  is  a  function  from  a  set  of 
choices  C  to  a  concatenation  of  members  of  S.  Intuitively,  /  is  an  idealized  searching 
facility  that  maps  some  description  of  a  choice  to  strings  that  should  satisfy  the 
choice.  (Function  /  abstracts  out  the  searching  process.)  Since  the  concatenation  of  a 
set  of  strings  is  a  string,  /  maps  (choice)  strings  to  (text)  strings. 

From  the  reader's  point  of  view,  the  optimal  solution  is  that  for  each  choice  c  € 
C,  /(c)  =  c.  That  is,  the  reader's  specification  of  his  or  her  choice  results  in  a 
concatenation  of  text  fragments  containing  exactly  the  information  requested  by  the 
choice.  Another  way  to  say  this  is  that  there  exists  a  set  of  (text)  strings  in  S  whose 
concatenation  is  (choice)  string  c.  Given  S  and  C,  if  there  exists  a  function  /  such 
that  /(c)  =  c  holds  for  each  c  (.  C,  we  say  that  5  is  in  reader  normal  form  with 
respect  to  C.  The  dependence  on  /  disappears,  since  we  only  need  to  be  able  to 
construct  /. 

Observe  that  we  are  changing  our  assumptions  about  the  readability  of  text 
fragments.  In  disciissing  linear  text,  we  assumed  that  any  substring  of  a  linear  text 
was  readable  in  isolation.  Here,  we  assume  that  readers  must  read  entire  text 
fragments  in  S  (or  prefixes  of  them),  not  arbitrary  substrings  of  those  fragments. 

The  author  of  5  has  a  different  cost  criterion:  the  number  of  times  the  same 
atom  appears  in  S.  The  author  woiild  prefer  each  atom  to  appear  exactly  once  in  S 
(i.e.  every  pair  of  strings  should  be  disjoint  and  each  string  should  have  no 
repetitions).   When  this  holds,  we  say  5  is  in  writer  normal  form. 

S  is  in  RW  normal  form  with  respect  to  C  if  it  is  in  reader  normal  form  with 
respect  to  C  and  in  writer  normal  form. 

Example:  Suppose  C  =  {abcde,ae  }  and  5  =  {  a,e,bcd  }.  5  is  in  RW  normal 
form  with  respect  to  C. 

We  now  turn  to  the  question  of  how  we  should  break  up  fragments  to  achieve 
RW  normal  form.  The  basic  idea  is  that  we  break  up  text  until  every  string  in  5  is 
disjoint  from  every  other  and  is  either  a  substring  of  any  given  choice  x  in  C  or  is 
disjoint  from  x.  We  present  an  algorithm  to  do  this  and  prove  that  it  produces  a 
unique  result  in  the  appendix. 

Example:  Suppose  C  =  {ab  ,cde ,cda}  and  our  initial  set  of  text  fragments  is  S' 
=  {abcde  ,acde} .  We  first  break  up  strings  until  they  are  in  writer  normal  form:  S  = 
{a,b,cde}.  Then  we  put  them  in  reader  normal  form:  S  =  {a,b,cd,e}. 

Whether  strings  must  be  split  up  does  not  depend  on  their  length  but  on  the 
other  strings  and  on  the  set  of  choices.  Since  cd  is  either  a  substring  or  disjoint  from 
any  given  string  in  C[JS',  it  remains  intact  in  the  output.  Similarly,  applying  the 
RW  algorithm  on  a  non-linear  text  system  containing  a  guidebook  and  a  book  of 
short  stories  might  create  small  pieces  out  of  the  gmdebook,  but  leave  each  story 
intact. 

In  situations  where  we  would  not  even  consider  splitting  up  text  strings,  we 
wouJd  like  to  be  able  to  determine  whether  a  given  set  of  strings  5  is  in  reader 
normal  form  or  writer  normal  form  with  respect  to  a  set  of  choices  C.  Deciding 
whether  S  is  in  writer  normal  form  is  just  a  matter  of  detecting  repetitions  of  the 
same  atoms.  As  for  reader  normal  form,  we  use  a  simple  dynamic  programming 
algorithm  that  determines  whether  there  is  a  set  from  S  that  concatenate  to  form  a 
given  choice  c . 
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function  satisfy (c,S):  returns  boolean 

Input:  c  is  a  choice  and  S  is  a  set  of  strings. 

Output:  Returns  true  if  there  is  a  concatenation  of  strings  from  S  equal  to  c.   False 

otherwise. 

begin 
create  a  graph  G^=(Vj^^) 
such  that  V^  =  {  0,1,2,.. .,Ic|} 
for  each  s  ^  S 
if  J  is  a  substring  of  c  from 
position  i  +  l  to  J 
then  (j  J)  e  E^ 
end  for 

if  there  is  a  path  from  0  to  |c|  in  G^ 
then  return  true 
else  return  false 
end 

Example:  If  C  =  {abc ,ace ,abe}  and  S  ^^  |«6,i«r,c,a ,..?},  then  5  is  in  reader 
normal  form,  because  some  concatenation  of  stcir.gs  in  S  equals  each  string  in  C.  But 
there  are  many  repetitions  in  S.* 

Since  the  amoimt  of  work  the  reader  must  do  is  often  the  prime  concern  of  a 
knowledge  exploration  system,  reader  normal  form  is  a  reasonable  goal  to  strive  for. 
The  satisfy  test  can  serve  as  the  basis  for  a  heuristic  that  would  help  decide  which 
fragments  it  may  be  worth  the  effort  to  break. 

4.  Conclusion 

We  have  used  a  formal  model  to  address  the  questions:  When  can  non-linear 
text  help?  How  much  can  non-linear  text  help?  How  big  should  the  text  fragments 
be  in  a  non-linear  text  system?  We  answer  the  first  question  by  giving  a  syntactic 
criterion  for  when  linear  text  is  sufficiently  powerful.  We  answer  the  second  by 
proposing  the  non-linearizability  measure.  We  answer  the  third,  by  proposing  two 
normal  forms  and  stating  conditions  on  a  set  of  strings  that  must  hold  to  obtain  each. 

The  model  leaves  some  important  problems  unresolved:^  How  do  we  determine 
the  set  of  choices?  How  do  we  know  that  the  user  will  specify  the  choice  correctly? 

As  a  practical  matter,  authors  may  have  to  guess  the  set  of  choices  and  refine 
them  through  user  feedback.  Sometimes,  the  choices  may  be  defined  at  the  schema 
level.  For  example,  the  reader  may  want  to  choose  events  by  location,  by 
participant,  or  by  topic,  so  each  event  should  be  a  self-contained  fragment;  or  the 
reader  may  want  to  see  all  questions  together  or  may  want  to  see  questions  and 
answers  together.  At  other  times,  large  portions  of  an  application  will  be 
linearizable,  with  only  a  portion  having  incompatible  choices.  The  model  suggests 
making  the  linearizable  portions  single  large  text  fragments.    There  is  no  virtue  in 


*  -  Some  repetitions  are  less  serious  than  others.  For  example,  if  x  is  the  prefix  of  y,  then  the 
system  may  not  need  a  text  fragment  for  x  as  well  as  y.  Instead,  the  system  can  present  an 
appropriate  prefix  of  y  in  response  to  a  request  for  x.   So  no  text  fragment  for  x  would  be  necessary. 

'  The  model  also  ignores  other  benefits  of  non-linear  text  systems  that  flow  from  their  being 
implemented  on  a  computer.  For  example,  they  can  allow  readers  to  annotate  text;  they  can  help  keep 
information  up-to-date;  and  they  may  store  ^e  same  amount  of  information  more  compactly  and 
cheaply.  It  can  also  help  structure  debates  [L85].  Non-linear  text  also  provides  a  platform  for  the 
black  arts  of  user  modeling,  automatic  paraphrasing,  and  so  on. 
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breaking  up  text,  unless  the  choices  require  it.  Helping  the  reader  specify  his  choices 
is  a  major  problem.  We  have  sketched  some  of  the  necessary  facilities  in  [S85]  and 
are  now  working  to  implement  them. 

In  spite  of  the  important  practical  problems  the  model  ignores,  we  think  it 
makes  three  contributions.  First,  it  suggests  that  workers  should  select  knowledge 
exploration  applications  for  non-linear  text  with  large  non-linearizable  measures.  For 
example,  an  encyclopedia  may  not  be  as  good  an  application  as  it  might  seem.  The 
choices  users  maJce  tend  to  match  well  with  the  articles.  So  the  text  is  linearizable  or 
nearly  so.  A  better  application  would  be  one  where  there  is  essentially  a  database 
structure,  i.e.  entities  with  multiple  attributes.  The  guidebook  example  is  an  instance 
of  this,  with  attributes  location,  topic,  price,  and  so  on.  Another  example  would  be  a 
manual  of  a  system  with  facilities  that  can  be  grouped  in  different  ways.  For 
example,  a  text  editor  may  delete,  insert,  and  move  text  by  marking  it  first.  The  user 
may  ask  how  to  delete  text  or  may  ask  how  to  mark  different  length  texts.  The 
choices  are  incompatible. 

Second,  the  model  describes  three  levels  of  expressive  power:  linearizable, 
parentheses  linearizable,  and  non-linear.  One  easy  conclusion  is  that  hierarchical 
connections  among  text  fragments  uj  a  non-linear  text  system  will  only  achieve 
parentheses  linearizability.  Hence  pure  outline  processors  are  not  as  powerftil  as 
non- linear  text  systems.  It  may  make  sense  to  allow  many  hierarchies  and  then 
include  a  special  mechanism  for  choices  that  differ  only  in  that  they  order  their  atoms 
differently.  Analysis  of  an  application  shouJd  lead  to  a  selection  of  the  expressive 
power  (and  hence  medium)  needed. 

Third,  this  work  may  convince  database  researchers  interested  in  artificial 
intelligence  that  there  is  a  middle  ground  between  viewing  text  as  uninterpreted 
character  strings  and  trying  to  design  a  natural  language  understanding  system. 
Instead,  the  model  suggests  that  an  analysis  of  the  informational  needs  of  a 
knowledge  exploration  system  is  analogous  to  the  analysis  that  database  designers 
undertake  for  structured  data.  Knowledge  exploration  is  a  ripe  area  for  the 
application  of  database  theory  and  design  techniques. 
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5.   Appendix:  Proob 

Theorem  1:  C  is  linearizable  if  and  only  if  every  pair  of  choices  in  C  is 
compatible  and  the  pre-overlap  graph  for  C  is  acyclic. 

Proof:  Without  loss  of  generality,  we  may  assume  that  no  string  in  C  is  a  proper 
substring  of  any  other  substring  in  C.  (If  C  is  linearizable,  then  each  member  of  C  is 
a  substring  of  some  string  s.  If  we  add  a  string  x  that  is  a  proper  substring  of  y  i  C, 
then  X  must  also  be  a  substring  of  s,  since  substring  is  transitive.) 

(If)  We  assume  that  every  pair  is  compatible  and  the  pre-overlap  graph  for  C  is 
acyclic.  We  prove  constructively  that  a  linear  string  without  repetitions  exists  that  has 
each  member  of  C  as  a  substring. 

Qaim  1:  If  j:  and  y  are  not  disjoint,  then  one  pre-overlaps  the  other. 

Proof  of  claim  1:  This  follows  from  proposition  1  and  our  assumption  that  C  has  no 
proper  substrings. 

Qaim  2:  If  x  pre-overlaps  y  and  x  pre-overlaps  y' ,  then  either  y  pre-overlaps  y' 
or  y'  pre-overlaps  y.  U  y  pre-overlaps  x  and  y'  pre-overlaps  x,  then  either  y  pre- 
overlaps  y'  or^-'  pre-overlaps  >>. 

Proof  of  claim  2:  In  either  case,  y  and  y'  are  not  disjoint,  since  they  overlap 
respectively  the  last  atom  in  x  or  the  first  one  in  x.  The  conclusion  then  follows  from 
claim  1. 

The  claims  imply  that  the  choices  can  be  partitioned  into  sequences  of  choices, 
called  pre-overlap  sequences,  defined  as  follows.  If  x  pre-overlaps  x'  and  there  is  no 
x"  such  that  x  pre-overlaps  x"  and  x"  pre-overlaps  x' ,  then  x  immediately  precedes 
x'  in  a  pre-overlap  sequence.  This  is  the  only  way  x  may  precede  x' .  Qaim  1 
implies  that  members  of  distinct  pre-overlap  sequences  are  disjoint.  Therefore,  if 
each  pre-overlap  sequence  is  linearizable,  then  C  is  linearizable.  So  the  following 
claim  ends  the  if  portion  of  the  proof. 

Qaim  3:  Each  pre-overlap  sequence  is  linearizable. 

Proof  of  claim  3:  If  the  sequence  has  only  one  choice  in  it,  that  choice  is  its 
linearization.  Suppose  that  the  first  it  choices  in  a  pre-overlap  sequence 
(xirX2,  •  •  •  ,x„)  are  linearizable  with  linearization  l^  such  that  the  first  atom  of  x^ 
precedes  the  first  atom  of  X2,  and  so  on.  So  x^  is  the  suffix  of  Z^.  Since  x^  pre- 
overlaps  Xji+|,  3  u,  V,  w  such  that  x^  =  «v  and  x^+i  =  vw.  String  w  must  be  disjoint 
from  every  member  of  Z^.  Otherwise  there  are  two  possibilities.  First,  there  is  an 
j<*  such  that  Xi^+i  pre-overlaps  x,  which  violates  the  acyclidty  condition.  Second,  x; 
would  pre-overlap  x^+i  and  therefore  would  not  be  disjoint  from  x^.  Since  i<k,  x, 
should  pre-overlap  x^,  but  instead  it  contains  x^  as  a  substring  which  is  impossible. 
So,  li^w  is  a  linearization  of  the  first  Jt+1  choices  in  the  given  pre-overlap  sequence. 

(Only  if)  We  show  that  if  C  is  linearizable,  then  each  pair  of  members  of  C  are 
compatible  and  the  pre-overlap  graph  for  C  is  acyclic. 

(Compatibility)  Let  j  be  a  superstring  without  repetitions  of  all  the  strings  in  C. 
Suppose  X,  y  i  C  but  they  are  not  compatible.  Then  they  must  have  at  least  one 
atom  in  common  (otherwise  they  are  disjoint  and  hence  compatible).  By  definition  of 
s  there  is  a  substring  z  of  s  without  repetitions  such  that  z  =  uxv  and  z=u'yv'  and 
either  «  or  u'  is  empty  and  either  v  or  v'  is  empty.  (Otherwise,  z  would  contain 
atoms  that  are  in  neither  x  nor  y.)  Let  us  consider  two  cases  (the  others  are 
symmetric): 
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i)  u  =  V  =  £.  Then  y  is  a  substring  of  x. 

u)  u  =  v'  =  S.  Then  xv  =  u'y.  So  either  x  and  y  are  disjoint  or  x  pre-overlaps  y.     ■ 

So  in  these  cases  and  the  other  symmetric  ones,  x  and  y  are  compatible. 

(Acyclidty)  Let  z  be  a  linearization  of  a  set  of  choices  C.  U  x  pre-overlaps  y, 
then  the  first  atom  of  x  must  precede  the  first  atom  of  y,  otherwise  the  common 
substring  of  x  and  y  would  have  to  be  repeated  twice.  Since  precede  is  transitive,  a 
cycle  would  imply  that  the  first  atom  of  x  must  precede  the  first  atom  of  x  causing  z 
to  have  repetitions.   [] 


5.1.  RW  normal  form  algorithm  and  theorem 

In  this  section,  we  describe  an  algorithm  that  takes  a  set  of  text  fragments  and  a 
set  of  choices  and  produces  a  set  of  text  fragments  in  RW  normal  form.  We  then 
verify  the  algorithm. 

function  break(x,y):  returns  set  of  strings; 

{initially:  x  and  y  have  one  or  more  common  symbols} 

begin 

Let  a  be  first  atom  in  x  that  appears  in  y. 

Let  V  be  the  longest  common  substring  of 
X  and  y  starting  at  a. 

Let  X  =  uvw,  y  =  u'vw'* 

return  {u,  v,  w}  -  {f  } 
end 

Our  algorithm  first  creates  a  set  of  strings  in  writer  normal  form,  then  creates 
them  in  reader  normal  form. 


proc  RW(S',C,S) 

Input:  S'  is  a  set  of  strings,  and  C  is  a  set  of  choices  such  that  the  atoms  in  S'  are  the 

same  as  those  in  C.   (Formally,  |J  •^'  ~  U  ^0 

Output:  S  is  in  RW  normal  form  with  respect  to  C. 

begin 

phase  1:  {transform  S'  into  S  in  writer  normal  form} 

S:=  S* 

repeat 
ToDo  :=  S 

for  each  pair  x,  y  of  members  of  ToDo 
that  are  not  disjoint 
begin 

S  :=  S  -  {x,y} 

S  :=  S  U  break(x,y)  (J  break(y,x) 
end  for 
if  ToDo  =  S  then  exit  {no  change} 
forever 


'  Since  v  is  as  long  as  possible,  the  first  symbol  of  w  must  differ  from  the  first  symbol  of  W. 
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phase  2:  {transform  S  into  reader  normal  form} 

repeat 
ToDo  :=  S 
for  each  x  C  ToDo 
if  there  is  c  €  C 
such  that  {x}  #  break(x,c) 
then  begin 

S  :=  S  -  {x}; 
S  :=  S  U  break(x,c) 
end 
end  for 

if  ToDo  =  S  then  exit  {no  change} 
forever 

end 


We  now  want  to  prove  the  algorithm  correct. 

Theorem  2:  Given  a  set  of  choices  C  and  a  set  of  strings  S'  such  that  \^C  = 
U  S' ,  algorithm  RW  terminates  and  always  produces  a  new  value  for  5  that  is  in  RW 
normal  form  with  respect  to  C.  Moreover,  the  value  of  S  is  uniquely  determined 
from  5'  andC.  [] 

Proposition  2:  The  function  break (x,y)  splits  x  into  strings  whose  atoms  partition 
X.  That  is,  {j«f(M')|w  €  break(x,y)}  partitions  x.  This  implies  that  if  {j:}  # 
break(x,y),  then  \x\  is  larger  than  the  maximum  length  member  of  break(x,y).   [] 

Lemma  1:  If  x  and  y  are  unequal  but  not  disjoint,  then  either  {jc}  #  break(x,y) 
or  {y}  ^  break(y,x). 

Proof:  break(x,y)  =  {  u,v,w}  -  {€}  implies  that  3  u'  ,w'  such  that  y  =  u'vw'  and 
u  ^  u'  OT  w  ^  w' ,  by  definition  of  the  break  function  and  since  x  and  y  are  unequal. 
If  {x}  =  break{x,y),  then  u  =  w  =  C.  That  implies  that  either  «'  or  w'  must  be 
non-empty.   [\ 

We  are  now  ready  to  prove  theorem  1. 

Proof  of  theorem  1:  We  divide  the  proof  into  four  claims.  The  first  one  shows 
termination.  The  second  and  third  verify  the  two  phases.  The  fourth  guarantees  a 
imique  solution. 

Qaim  1  (Termination):  Both  phases  terminate. 

Proof  of  claim  1:  Any  time  ToDo  ^  S,  a  string  has  been  broken  into  substrings  by  the 
function  break.  By  proposition  2,  they  must  be  smaller  than  the  original  string.  But 
no  string  can  have  fewer  than  one  atom. 

Qaim  2  (First  phase):  Phase  one  produces  a  set  of  sequences  in  writer  normal 
form. 

Proof  of  claim  2:  Suppose  some  atom  is  in  two  distinct  strings  x  and  y  at  the  end  of 
the  first  phase.  By  lemma  1,  either  {x}  #  break(x,y)  or  {y}  =^  breakiy^),  so  the 
phase  would  not  have  terminated. 

Qaim  3  (Second  phase):  Phase  two  produces  a  set  of  sequences  in  RW  normal 
form. 
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Proof  of  claim  3:  By  proposition  2  and  the  fact  that  each  string  in  5  is  broken  at  most 
once  in  a  single  loop  of  Ae  algorithm,  the  number  of  instances  of  any  atom  in  5  does 
not  change.  So  S  remains  in  writer  normal  form  and  every  atom  in  C  is  in  exactly 
one  string  in  5.  Moreover,  if  some  x  ^  S  shares  one  or  more  atoms  with  some  c  ^  C 
at  the  end  of  phase  two,  then  x  must  be  a  substring  of  c.  Otherwise  {x}  # 
break(x,c),  and  the  second  phase  wouldn't  terminate.  These  facts  imply  that  if  we 
collect  the  substrings  of  c  in  5  and  order  them  by  where  their  first  atom  appears  in  c, 
the  resulting  concatenation  will  equal  c. 

Claim  4  (Uniqueness):  The  set  of  output  strings  5  is  uniquely  determined  by  the 
set  of  choices  C  and  input  strings  S' . 

Proof  of  claim  4:  The  proof  follows  from  the  following  observation.  For  any 
pair  of  atoms  a  and  b,  ab  is  a  substring  of  an  output  string  if  and  only  if  ab  is  & 
substring  of  at  least  one  member  of  S'  and  for  any  x  6  C[JS' ,  ab  is  disjoint  from  x 
or  ab  is  a  substring  of  x. 

(The  if  part  of  the  observation  holds  because  no  invocation  of  break  will  separate  a 
from  b,  by  definition  of  break.  The  only  if  part  holds  for  two  reasons.  First,  break 
never  concatenates  atoms  (so  ab  must  be  a  substring  of  some  member  of  5'). 
Second,  some  invocation  of  break  would  split  a  from  b  if  there  were  a  string  in 
S'  (J  C  with  ab'  asa  substring  where  b'  #  b)  or  a'b  as  a  substring  where  a'  *  a.) 

Suppose  C1C2  •  •  •  Cjt  is  in  the  output  for  some  execution  of  the  algorithm.  By  the 
observation,  c^C2  must  be  a  substring  of  some  output  string  in  any  execution.  So 
must  C2C3.  Since  only  one  output  string  contains  Cj,  C1C2C2  must  be  a  substring  of 
some  output  string.  The  result  follows  by  simple  induction.   Q 

Note  that  without  the  first  phase,  the  second  phase  would  not  put  S  into  reader 
normal  form  for  C.  For  example  applying  phase  2  to  5  =  {abc,bcd  )  and  C  =  {abed} 
would  not  change  S. 
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